-
The idea that there is one “Japanese language model” for various Japanese sentences.
-
I question this notion.
-
Different people have different language models. - Different people have different vocabularies.
-
Books also have different language models.
-
Some models are close, some are far away.
-
Easier to understand if the model is close
-
A worldview where there is not one huge language model, but several language models talking to each other
This page is auto-translated from /nishio/「日本語の言語モデル」は実在するか using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I’m very happy to spread my thought to non-Japanese readers.